2026-09-30 16:03:54,410 [ 58146 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-09-30 16:03:54,410 [ 58146 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-09-30 16:03:54,410 [ 58146 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-09-30 16:03:54,410 [ 58146 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_a5g77r --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_accept_invalid_certificate/test.py::test_accept test_accept_invalid_certificate/test.py::test_connection_accept test_accept_invalid_certificate/test.py::test_default test_accept_invalid_certificate/test.py::test_strict_connection_reject test_accept_invalid_certificate/test.py::test_strict_reject test_accept_invalid_certificate/test.py::test_strict_reject_with_config test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_backup_log/test.py::test_backup_log 'test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3]' 'test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain]' test_backup_restore_s3/test.py::test_backup_to_s3 test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials test_backup_restore_s3/test.py::test_backup_to_s3_multipart test_backup_restore_s3/test.py::test_backup_to_s3_named_collection 'test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3]' 'test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_other_bucket]' 'test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_plain_rewritable]' test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart test_backup_restore_s3/test.py::test_backup_to_tar test_backup_restore_s3/test.py::test_backup_to_tar_bz2 test_backup_restore_s3/test.py::test_backup_to_tar_gz test_backup_restore_s3/test.py::test_backup_to_tar_lzma test_backup_restore_s3/test.py::test_backup_to_tar_xz test_backup_restore_s3/test.py::test_backup_to_tar_zst test_backup_restore_s3/test.py::test_backup_to_zip 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True]' test_backup_restore_s3/test.py::test_incremental_backup_append_table_def test_backup_restore_s3/test.py::test_user_specific_auth test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability test_compression_nested_columns/test.py::test_nested_compression_codec test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool test_config_reloader_interval/test.py::test_reload_config test_consistant_parts_after_move_partition/test.py::test_consistent_part_after_move_partition test_dictionaries_access/test.py::test_create test_dictionaries_access/test.py::test_dictget test_dictionaries_access/test.py::test_drop 'test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_simple[cache]' test_dictionaries_config_reload/test.py::test 'test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0]' 'test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1]' 'test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2]' 'test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3]' test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxRollback]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxRollback]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxRollback]' test_executable_user_defined_function/test.py::test_executable_function_always_error_python test_executable_user_defined_function/test.py::test_executable_function_argument_python test_executable_user_defined_function/test.py::test_executable_function_bash test_executable_user_defined_function/test.py::test_executable_function_input_nullable_python test_executable_user_defined_function/test.py::test_executable_function_non_direct_bash test_executable_user_defined_function/test.py::test_executable_function_parameter_python test_executable_user_defined_function/test.py::test_executable_function_python test_executable_user_defined_function/test.py::test_executable_function_send_chunk_header_python test_executable_user_defined_function/test.py::test_executable_function_signalled_python test_executable_user_defined_function/test.py::test_executable_function_slow_python test_executable_user_defined_function/test.py::test_executable_function_sum_json_python test_executable_user_defined_function/test.py::test_executable_function_sum_python test_extreme_deduplication/test.py::test_deduplication_window_in_seconds test_failed_async_inserts/test.py::test_failed_async_inserts 'test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PART-2020-08-28-20200828_0_0_0]' 'test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PARTITION-2020-08-27-2020-08-27]' test_groupBitmapAnd_on_distributed/test.py::test_groupBitmapAnd_on_distributed_table -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_accept_invalid_certificate/test.py::test_accept test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] test_access_control_on_cluster/test.py::test_access_control_on_cluster test_executable_user_defined_function/test.py::test_executable_function_always_error_python test_dictionaries_access/test.py::test_create test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_complex[complex_key_cache] test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] [gw3] [ 1%] PASSED test_accept_invalid_certificate/test.py::test_accept test_accept_invalid_certificate/test.py::test_connection_accept [gw3] [ 2%] PASSED test_accept_invalid_certificate/test.py::test_connection_accept test_accept_invalid_certificate/test.py::test_default [gw3] [ 3%] PASSED test_accept_invalid_certificate/test.py::test_default test_accept_invalid_certificate/test.py::test_strict_connection_reject [gw3] [ 4%] PASSED test_accept_invalid_certificate/test.py::test_strict_connection_reject test_accept_invalid_certificate/test.py::test_strict_reject [gw3] [ 5%] PASSED test_accept_invalid_certificate/test.py::test_strict_reject test_accept_invalid_certificate/test.py::test_strict_reject_with_config [gw3] [ 6%] PASSED test_accept_invalid_certificate/test.py::test_strict_reject_with_config [gw6] [ 7%] PASSED test_dictionaries_access/test.py::test_create test_dictionaries_access/test.py::test_dictget [gw6] [ 8%] PASSED test_dictionaries_access/test.py::test_dictget test_dictionaries_access/test.py::test_drop [gw6] [ 9%] PASSED test_dictionaries_access/test.py::test_drop test_async_insert_memory/test.py::test_memory_usage [gw0] [ 10%] PASSED test_executable_user_defined_function/test.py::test_executable_function_always_error_python test_executable_user_defined_function/test.py::test_executable_function_argument_python [gw0] [ 11%] PASSED test_executable_user_defined_function/test.py::test_executable_function_argument_python test_executable_user_defined_function/test.py::test_executable_function_bash [gw7] [ 12%] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] [gw1] [ 13%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] [gw0] [ 14%] PASSED test_executable_user_defined_function/test.py::test_executable_function_bash test_executable_user_defined_function/test.py::test_executable_function_input_nullable_python [gw0] [ 15%] PASSED test_executable_user_defined_function/test.py::test_executable_function_input_nullable_python test_executable_user_defined_function/test.py::test_executable_function_non_direct_bash test_backup_log/test.py::test_backup_log [gw0] [ 16%] PASSED test_executable_user_defined_function/test.py::test_executable_function_non_direct_bash test_executable_user_defined_function/test.py::test_executable_function_parameter_python [gw5] [ 17%] PASSED test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] [gw7] [ 18%] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] [gw0] [ 19%] PASSED test_executable_user_defined_function/test.py::test_executable_function_parameter_python test_executable_user_defined_function/test.py::test_executable_function_python [gw0] [ 20%] PASSED test_executable_user_defined_function/test.py::test_executable_function_python test_executable_user_defined_function/test.py::test_executable_function_send_chunk_header_python [gw0] [ 21%] PASSED test_executable_user_defined_function/test.py::test_executable_function_send_chunk_header_python test_executable_user_defined_function/test.py::test_executable_function_signalled_python [gw0] [ 22%] PASSED test_executable_user_defined_function/test.py::test_executable_function_signalled_python test_executable_user_defined_function/test.py::test_executable_function_slow_python [gw5] [ 23%] PASSED test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary [gw9] [ 24%] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_complex[complex_key_cache] test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_simple[cache] [gw1] [ 25%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] [gw5] [ 26%] PASSED test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] [gw4] [ 27%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated [gw5] [ 28%] PASSED test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] [gw1] [ 29%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] [gw9] [ 30%] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_simple[cache] test_config_reloader_interval/test.py::test_reload_config [gw1] [ 31%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PART-2020-08-28-20200828_0_0_0] [gw0] [ 32%] PASSED test_executable_user_defined_function/test.py::test_executable_function_slow_python test_executable_user_defined_function/test.py::test_executable_function_sum_json_python [gw0] [ 33%] PASSED test_executable_user_defined_function/test.py::test_executable_function_sum_json_python test_executable_user_defined_function/test.py::test_executable_function_sum_python [gw0] [ 34%] PASSED test_executable_user_defined_function/test.py::test_executable_function_sum_python test_groupBitmapAnd_on_distributed/test.py::test_groupBitmapAnd_on_distributed_table [gw1] [ 35%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] [gw1] [ 36%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] [gw8] [ 37%] PASSED test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster [gw8] [ 38%] PASSED test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster [gw8] [ 39%] PASSED test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster [gw1] [ 40%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] [gw7] [ 41%] PASSED test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary [gw7] [ 42%] PASSED test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary [gw3] [ 43%] PASSED test_async_insert_memory/test.py::test_memory_usage [gw1] [ 44%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-NoTx] test_consistant_parts_after_move_partition/test.py::test_consistent_part_after_move_partition [gw6] [ 45%] PASSED test_backup_log/test.py::test_backup_log test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic [gw5] [ 46%] PASSED test_config_reloader_interval/test.py::test_reload_config [gw1] [ 47%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-NoTx] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxCommit] [gw9] [ 48%] PASSED test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PART-2020-08-28-20200828_0_0_0] test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PARTITION-2020-08-27-2020-08-27] test_dictionaries_config_reload/test.py::test [gw9] [ 49%] PASSED test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PARTITION-2020-08-27-2020-08-27] [gw0] [ 50%] PASSED test_groupBitmapAnd_on_distributed/test.py::test_groupBitmapAnd_on_distributed_table [gw1] [ 51%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxCommit] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxNotFinished] [gw4] [ 52%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_failed_async_inserts/test.py::test_failed_async_inserts [gw1] [ 53%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxNotFinished] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxRollback] [gw1] [ 54%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxRollback] test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-NoTx] [gw1] [ 55%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-NoTx] test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxCommit] [gw1] [ 56%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxCommit] test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxNotFinished] [gw7] [ 57%] PASSED test_consistant_parts_after_move_partition/test.py::test_consistent_part_after_move_partition [gw1] [ 58%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxNotFinished] test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxRollback] [gw3] [ 59%] PASSED test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability [gw1] [ 60%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxRollback] test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-NoTx] [gw9] [ 61%] PASSED test_failed_async_inserts/test.py::test_failed_async_inserts [gw1] [ 62%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-NoTx] test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxCommit] [gw5] [ 63%] PASSED test_dictionaries_config_reload/test.py::test [gw4] [ 64%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool test_extreme_deduplication/test.py::test_deduplication_window_in_seconds [gw1] [ 65%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxCommit] test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxNotFinished] [gw4] [ 66%] PASSED test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool [gw1] [ 67%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxNotFinished] test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxRollback] [gw1] [ 68%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxRollback] [gw3] [ 69%] PASSED test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability [gw5] [ 70%] PASSED test_extreme_deduplication/test.py::test_deduplication_window_in_seconds [gw6] [ 71%] PASSED test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic test_compression_nested_columns/test.py::test_nested_compression_codec [gw6] [ 72%] PASSED test_compression_nested_columns/test.py::test_nested_compression_codec [gw2] [ 73%] ERROR test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] [gw2] [ 74%] ERROR test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] [gw2] [ 75%] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] [gw2] [ 76%] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] [gw2] [ 77%] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] [gw2] [ 78%] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] [gw2] [ 79%] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] test_backup_restore_s3/test.py::test_backup_to_s3 [gw2] [ 80%] ERROR test_backup_restore_s3/test.py::test_backup_to_s3 test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials [gw2] [ 81%] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials test_backup_restore_s3/test.py::test_backup_to_s3_multipart [gw2] [ 82%] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_multipart test_backup_restore_s3/test.py::test_backup_to_s3_named_collection [gw2] [ 83%] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_named_collection test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3] [gw2] [ 84%] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3] test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_other_bucket] [gw2] [ 85%] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_other_bucket] test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_plain_rewritable] [gw2] [ 86%] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_plain_rewritable] test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart [gw2] [ 87%] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart test_backup_restore_s3/test.py::test_backup_to_tar [gw2] [ 88%] ERROR test_backup_restore_s3/test.py::test_backup_to_tar test_backup_restore_s3/test.py::test_backup_to_tar_bz2 [gw2] [ 89%] ERROR test_backup_restore_s3/test.py::test_backup_to_tar_bz2 test_backup_restore_s3/test.py::test_backup_to_tar_gz [gw2] [ 90%] ERROR test_backup_restore_s3/test.py::test_backup_to_tar_gz test_backup_restore_s3/test.py::test_backup_to_tar_lzma [gw2] [ 91%] ERROR test_backup_restore_s3/test.py::test_backup_to_tar_lzma test_backup_restore_s3/test.py::test_backup_to_tar_xz [gw2] [ 92%] ERROR test_backup_restore_s3/test.py::test_backup_to_tar_xz test_backup_restore_s3/test.py::test_backup_to_tar_zst [gw2] [ 93%] ERROR test_backup_restore_s3/test.py::test_backup_to_tar_zst test_backup_restore_s3/test.py::test_backup_to_zip [gw2] [ 94%] ERROR test_backup_restore_s3/test.py::test_backup_to_zip test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] [gw2] [ 95%] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] [gw2] [ 96%] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] [gw2] [ 97%] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] [gw2] [ 98%] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] test_backup_restore_s3/test.py::test_incremental_backup_append_table_def [gw2] [ 99%] ERROR test_backup_restore_s3/test.py::test_incremental_backup_append_table_def test_backup_restore_s3/test.py::test_user_specific_auth [gw2] [100%] ERROR test_backup_restore_s3/test.py::test_user_specific_auth ==================================== ERRORS ==================================== _ ERROR at setup of test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] __ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo3 ... Pulling minio1 ... Pulling node ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:03:58 [ 479 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:03:58 [ 479 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:03:58 [ 479 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:03:58 [ 479 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:03:58 [ 479 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:03:58 [ 479 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:03:58 [ 479 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:03:58 [ 479 ] INFO : Running tests in /ClickHouse/tests/integration/test_backup_restore_s3/test.py (cluster.py:2790, start) 2026-09-30 16:03:58 [ 479 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:03:59 [ 479 ] DEBUG : Docker networks for project roottestbackuprestores3_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:03:59 [ 479 ] DEBUG : Docker containers for project roottestbackuprestores3_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:03:59 [ 479 ] DEBUG : Docker volumes for project roottestbackuprestores3_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:03:59 [ 479 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:03:59 [ 479 ] DEBUG : Docker networks for project roottestbackuprestores3_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:03:59 [ 479 ] DEBUG : Docker containers for project roottestbackuprestores3_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:03:59 [ 479 ] DEBUG : Docker volumes for project roottestbackuprestores3_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:03:59 [ 479 ] DEBUG : Command:docker container list --all --filter name='^/roottestbackuprestores3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:03:59 [ 479 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:03:59 [ 479 ] DEBUG : No running containers for project: roottestbackuprestores3_gw2 (cluster.py:904, cleanup) 2026-09-30 16:03:59 [ 479 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:03:59 [ 479 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:03:59 [ 479 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:03:59 [ 479 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:03:59 [ 479 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:03:59 [ 479 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:03:59 [ 479 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:03:59 [ 479 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:03:59 [ 479 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:03:59 [ 479 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_backup_restore_s3/configs/disk_s3.xml', '/ClickHouse/tests/integration/test_backup_restore_s3/configs/named_collection_s3_backups.xml', '/ClickHouse/tests/integration/test_backup_restore_s3/configs/s3_settings.xml', '/ClickHouse/tests/integration/test_backup_restore_s3/configs/blob_log.xml', '/ClickHouse/tests/integration/test_backup_restore_s3/configs/remote_servers.xml'] to /ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:03:59 [ 479 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/database (cluster.py:4653, create_dir) 2026-09-30 16:03:59 [ 479 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:03:59 [ 479 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:03:59 [ 479 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env (cluster.py:86, _create_env_file) 2026-09-30 16:03:59 [ 479 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:03:59 [ 479 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:03:59 [ 479 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:03:59 [ 479 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:03:59 [ 479 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:03:59 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:05:43 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:05:43 [ 479 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:05:45 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:07:13 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:07:13 [ 479 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo1 ... Pulling zoo2 ... Pulling zoo3 ... Pulling node ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:07:16 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:08:55 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:08:55 [ 479 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling zoo3 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node ... done Pulling zoo3 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:08:59 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:10:53 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:10:53 [ 479 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:10:58 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:12:42 [ 479 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo3 ... Pulling minio1 ... Pulling node ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:12:42 [ 479 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:12:42 [ 479 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:12:42 [ 479 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:12:42 [ 479 ] DEBUG : Docker networks for project roottestbackuprestores3_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:12:42 [ 479 ] DEBUG : Docker containers for project roottestbackuprestores3_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:12:42 [ 479 ] DEBUG : Docker volumes for project roottestbackuprestores3_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:12:42 [ 479 ] DEBUG : Command:docker container list --all --filter name='^/roottestbackuprestores3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:12:42 [ 479 ] DEBUG : No running containers for project: roottestbackuprestores3_gw2 (cluster.py:904, cleanup) 2026-09-30 16:12:42 [ 479 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:12:42 [ 479 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:12:42 [ 479 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:12:42 [ 479 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:12:42 [ 479 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:12:42 [ 479 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:12:42 [ 479 ] DEBUG : Docker networks for project roottestbackuprestores3_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:12:42 [ 479 ] DEBUG : Docker containers for project roottestbackuprestores3_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:12:43 [ 479 ] DEBUG : Docker volumes for project roottestbackuprestores3_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:12:43 [ 479 ] DEBUG : Command:docker container list --all --filter name='^/roottestbackuprestores3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:12:43 [ 479 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:12:43 [ 479 ] DEBUG : No running containers for project: roottestbackuprestores3_gw2 (cluster.py:904, cleanup) 2026-09-30 16:12:43 [ 479 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:12:43 [ 479 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:12:43 [ 479 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:12:43 [ 479 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _ ERROR at setup of test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] _ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_disk[from_local_to_local] __________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_backup_to_disk[from_local_to_s3] ____________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_backup_to_disk[from_local_to_s3_plain] _________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_backup_to_disk[from_s3_to_local] ____________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_disk[from_s3_to_s3_plain] __________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________________ ERROR at setup of test_backup_to_s3 ______________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_s3_different_credentials ___________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_backup_to_s3_multipart _________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_backup_to_s3_named_collection _____________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_s3_native_copy[policy_s3] __________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___ ERROR at setup of test_backup_to_s3_native_copy[policy_s3_other_bucket] ____ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_backup_to_s3_native_copy[policy_s3_plain_rewritable] __ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_s3_native_copy_multipart ___________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________________ ERROR at setup of test_backup_to_tar _____________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_backup_to_tar_bz2 ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_backup_to_tar_gz ____________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________________ ERROR at setup of test_backup_to_tar_lzma ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_backup_to_tar_xz ____________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_backup_to_tar_zst ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________________ ERROR at setup of test_backup_to_zip _____________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_backup_with_fs_cache[False-True-False] _________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_backup_with_fs_cache[True-False-False] _________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_backup_with_fs_cache[True-True-False] _________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_backup_with_fs_cache[True-True-True] __________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_incremental_backup_append_table_def __________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________________ ERROR at setup of test_user_specific_auth ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:145: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ============================== slowest durations =============================== 524.19s setup test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] 135.49s setup test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic 101.72s setup test_access_control_on_cluster/test.py::test_access_control_on_cluster 88.95s call test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic 74.49s setup test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 69.88s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 68.42s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 64.40s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 61.75s setup test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] 60.32s setup test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 60.28s setup test_executable_user_defined_function/test.py::test_executable_function_always_error_python 59.91s setup test_extreme_deduplication/test.py::test_deduplication_window_in_seconds 59.41s setup test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field 59.03s setup test_compression_nested_columns/test.py::test_nested_compression_codec 58.91s setup test_consistant_parts_after_move_partition/test.py::test_consistent_part_after_move_partition 56.66s setup test_dictionaries_config_reload/test.py::test 56.07s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 55.43s setup test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_complex[complex_key_cache] 54.94s setup test_failed_async_inserts/test.py::test_failed_async_inserts 54.83s setup test_dictionaries_access/test.py::test_create 54.68s setup test_accept_invalid_certificate/test.py::test_accept 53.82s setup test_backup_log/test.py::test_backup_log 49.02s setup test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary 48.78s setup test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PART-2020-08-28-20200828_0_0_0] 47.23s setup test_config_reloader_interval/test.py::test_reload_config 45.76s setup test_groupBitmapAnd_on_distributed/test.py::test_groupBitmapAnd_on_distributed_table 35.94s setup test_async_insert_memory/test.py::test_memory_usage 22.53s call test_async_insert_memory/test.py::test_memory_usage 20.45s call test_dictionaries_config_reload/test.py::test 20.39s call test_executable_user_defined_function/test.py::test_executable_function_slow_python 12.92s call test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_complex[complex_key_cache] 12.54s teardown test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PARTITION-2020-08-27-2020-08-27] 11.19s call test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_simple[cache] 10.59s call test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-NoTx] 10.56s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxRollback] 10.31s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 10.16s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxCommit] 10.07s call test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxNotFinished] 10.02s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxNotFinished] 10.00s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 9.79s call test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxRollback] 9.57s call test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxCommit] 9.48s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 9.48s call test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-NoTx] 9.30s call test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 9.21s call test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxNotFinished] 9.15s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-NoTx] 9.09s teardown test_groupBitmapAnd_on_distributed/test.py::test_groupBitmapAnd_on_distributed_table 9.07s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 8.94s call test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxCommit] 8.94s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 8.77s call test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field 8.43s call test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxRollback] 7.49s call test_consistant_parts_after_move_partition/test.py::test_consistent_part_after_move_partition 7.00s call test_extreme_deduplication/test.py::test_deduplication_window_in_seconds 6.55s teardown test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] 6.49s call test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 6.44s call test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 6.33s call test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 6.28s call test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 6.16s teardown test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 6.08s teardown test_consistant_parts_after_move_partition/test.py::test_consistent_part_after_move_partition 5.86s teardown test_failed_async_inserts/test.py::test_failed_async_inserts 5.65s teardown test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 5.40s teardown test_extreme_deduplication/test.py::test_deduplication_window_in_seconds 5.25s teardown test_compression_nested_columns/test.py::test_nested_compression_codec 5.19s call test_backup_log/test.py::test_backup_log 5.10s teardown test_dictionaries_access/test.py::test_drop 5.06s teardown test_accept_invalid_certificate/test.py::test_strict_reject_with_config 5.00s teardown test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 4.48s teardown test_config_reloader_interval/test.py::test_reload_config 4.31s call test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] 4.23s teardown test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary 4.05s teardown test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_simple[cache] 3.90s teardown test_async_insert_memory/test.py::test_memory_usage 3.79s teardown test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 3.04s call test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] 2.74s teardown test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic 2.53s call test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] 2.30s call test_compression_nested_columns/test.py::test_nested_compression_codec 2.24s teardown test_dictionaries_config_reload/test.py::test 2.14s teardown test_executable_user_defined_function/test.py::test_executable_function_sum_python 2.11s teardown test_backup_log/test.py::test_backup_log 1.93s call test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 1.89s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxRollback] 1.87s call test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] 1.75s call test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 1.71s call test_dictionaries_access/test.py::test_create 1.49s call test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 1.27s call test_access_control_on_cluster/test.py::test_access_control_on_cluster 1.24s teardown test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field 1.08s call test_executable_user_defined_function/test.py::test_executable_function_sum_json_python 1.04s call test_config_reloader_interval/test.py::test_reload_config 0.96s call test_executable_user_defined_function/test.py::test_executable_function_always_error_python 0.94s call test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 0.89s call test_dictionaries_access/test.py::test_dictget 0.72s call test_executable_user_defined_function/test.py::test_executable_function_input_nullable_python 0.68s call test_executable_user_defined_function/test.py::test_executable_function_parameter_python 0.64s call test_executable_user_defined_function/test.py::test_executable_function_bash 0.63s call test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PART-2020-08-28-20200828_0_0_0] 0.62s call test_failed_async_inserts/test.py::test_failed_async_inserts 0.58s call test_executable_user_defined_function/test.py::test_executable_function_signalled_python 0.58s call test_executable_user_defined_function/test.py::test_executable_function_argument_python 0.55s call test_groupBitmapAnd_on_distributed/test.py::test_groupBitmapAnd_on_distributed_table 0.48s call test_access_control_on_cluster/test.py::test_grant_all_on_cluster 0.44s call test_dictionaries_access/test.py::test_drop 0.42s call test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PARTITION-2020-08-27-2020-08-27] 0.40s call test_executable_user_defined_function/test.py::test_executable_function_send_chunk_header_python 0.33s call test_executable_user_defined_function/test.py::test_executable_function_python 0.33s call test_executable_user_defined_function/test.py::test_executable_function_non_direct_bash 0.32s call test_executable_user_defined_function/test.py::test_executable_function_sum_python 0.20s call test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary 0.17s call test_accept_invalid_certificate/test.py::test_connection_accept 0.17s teardown test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] 0.13s teardown test_dictionaries_access/test.py::test_create 0.13s teardown test_dictionaries_access/test.py::test_dictget 0.12s call test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary 0.12s call test_accept_invalid_certificate/test.py::test_strict_reject 0.12s call test_accept_invalid_certificate/test.py::test_strict_reject_with_config 0.12s teardown test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] 0.12s call test_accept_invalid_certificate/test.py::test_accept 0.12s teardown test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] 0.07s call test_accept_invalid_certificate/test.py::test_default 0.07s call test_accept_invalid_certificate/test.py::test_strict_connection_reject 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_always_error_python 0.00s setup test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-NoTx] 0.00s setup test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] 0.00s setup test_dictionaries_access/test.py::test_drop 0.00s setup test_dictionaries_access/test.py::test_dictget 0.00s teardown test_backup_restore_s3/test.py::test_user_specific_auth 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxNotFinished] 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_bash 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxRollback] 0.00s teardown test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 0.00s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_argument_python 0.00s setup test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] 0.00s teardown test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PART-2020-08-28-20200828_0_0_0] 0.00s setup test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_signalled_python 0.00s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 0.00s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 0.00s setup test_accept_invalid_certificate/test.py::test_default 0.00s teardown test_accept_invalid_certificate/test.py::test_accept 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_sum_json_python 0.00s setup test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_parameter_python 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_slow_python 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_argument_python 0.00s setup test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PARTITION-2020-08-27-2020-08-27] 0.00s setup test_accept_invalid_certificate/test.py::test_connection_accept 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxCommit] 0.00s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxNotFinished] 0.00s teardown test_access_control_on_cluster/test.py::test_access_control_on_cluster 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_send_chunk_header_python 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_complex[complex_key_cache] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxNotFinished] 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_signalled_python 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxRollback] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxCommit] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-NoTx] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxCommit] 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_non_direct_bash 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxCommit] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 0.00s setup test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxRollback] 0.00s teardown test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_simple[cache] 0.00s setup test_access_control_on_cluster/test.py::test_grant_all_on_cluster 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxNotFinished] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_zip 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-NoTx] 0.00s setup test_accept_invalid_certificate/test.py::test_strict_reject_with_config 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_input_nullable_python 0.00s teardown test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 0.00s setup test_accept_invalid_certificate/test.py::test_strict_connection_reject 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] 0.00s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxNotFinished] 0.00s setup test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-NoTx] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxCommit] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-NoTx] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3] 0.00s teardown test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_zip 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_named_collection 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-NoTx] 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_slow_python 0.00s teardown test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_bz2 0.00s teardown test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_multipart 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials 0.00s teardown test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_sum_python 0.00s teardown test_accept_invalid_certificate/test.py::test_strict_reject 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_plain_rewritable] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_xz 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxNotFinished] 0.00s teardown test_access_control_on_cluster/test.py::test_grant_all_on_cluster 0.00s setup test_accept_invalid_certificate/test.py::test_strict_reject 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxRollback] 0.00s teardown test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_gz 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_zst 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_other_bucket] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_python 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_send_chunk_header_python 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxRollback] 0.00s teardown test_backup_restore_s3/test.py::test_incremental_backup_append_table_def 0.00s setup test_executable_user_defined_function/test.py::test_executable_function_non_direct_bash 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxCommit] 0.00s setup test_backup_restore_s3/test.py::test_incremental_backup_append_table_def 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_lzma 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_multipart 0.00s teardown test_accept_invalid_certificate/test.py::test_strict_connection_reject 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar 0.00s setup test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] 0.00s setup test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] 0.00s setup test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] 0.00s setup test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_bash 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_gz 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_zst 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_parameter_python 0.00s setup test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] 0.00s setup test_backup_restore_s3/test.py::test_user_specific_auth 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_named_collection 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_plain_rewritable] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_lzma 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_other_bucket] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_xz 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_bz2 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] 0.00s teardown test_accept_invalid_certificate/test.py::test_default 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_sum_json_python 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] 0.00s teardown test_accept_invalid_certificate/test.py::test_connection_accept 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_input_nullable_python 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] 0.00s teardown test_executable_user_defined_function/test.py::test_executable_function_python =========================== short test summary info ============================ ERROR test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] ERROR test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] ERROR test_backup_restore_s3/test.py::test_backup_to_s3 - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials ERROR test_backup_restore_s3/test.py::test_backup_to_s3_multipart - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_s3_named_collection - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_other_bucket] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_plain_rewritable] ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart ERROR test_backup_restore_s3/test.py::test_backup_to_tar - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_bz2 - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_gz - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_lzma - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_xz - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_zst - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_to_zip - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] ERROR test_backup_restore_s3/test.py::test_incremental_backup_append_table_def ERROR test_backup_restore_s3/test.py::test_user_specific_auth - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/.env', '--project-name', 'roottestbackuprestores3_gw2', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... PASSED test_accept_invalid_certificate/test.py::test_accept PASSED test_accept_invalid_certificate/test.py::test_connection_accept PASSED test_accept_invalid_certificate/test.py::test_default PASSED test_accept_invalid_certificate/test.py::test_strict_connection_reject PASSED test_accept_invalid_certificate/test.py::test_strict_reject PASSED test_accept_invalid_certificate/test.py::test_strict_reject_with_config PASSED test_dictionaries_access/test.py::test_create PASSED test_dictionaries_access/test.py::test_dictget PASSED test_dictionaries_access/test.py::test_drop PASSED test_executable_user_defined_function/test.py::test_executable_function_always_error_python PASSED test_executable_user_defined_function/test.py::test_executable_function_argument_python PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] PASSED test_executable_user_defined_function/test.py::test_executable_function_bash PASSED test_executable_user_defined_function/test.py::test_executable_function_input_nullable_python PASSED test_executable_user_defined_function/test.py::test_executable_function_non_direct_bash PASSED test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] PASSED test_executable_user_defined_function/test.py::test_executable_function_parameter_python PASSED test_executable_user_defined_function/test.py::test_executable_function_python PASSED test_executable_user_defined_function/test.py::test_executable_function_send_chunk_header_python PASSED test_executable_user_defined_function/test.py::test_executable_function_signalled_python PASSED test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_complex[complex_key_cache] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] PASSED test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool PASSED test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_simple[cache] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] PASSED test_executable_user_defined_function/test.py::test_executable_function_slow_python PASSED test_executable_user_defined_function/test.py::test_executable_function_sum_json_python PASSED test_executable_user_defined_function/test.py::test_executable_function_sum_python PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] PASSED test_access_control_on_cluster/test.py::test_access_control_on_cluster PASSED test_access_control_on_cluster/test.py::test_grant_all_on_cluster PASSED test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] PASSED test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary PASSED test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary PASSED test_async_insert_memory/test.py::test_memory_usage PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] PASSED test_backup_log/test.py::test_backup_log PASSED test_config_reloader_interval/test.py::test_reload_config PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-NoTx] PASSED test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PART-2020-08-28-20200828_0_0_0] PASSED test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PARTITION-2020-08-27-2020-08-27] PASSED test_groupBitmapAnd_on_distributed/test.py::test_groupBitmapAnd_on_distributed_table PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxCommit] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxNotFinished] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxRollback] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-NoTx] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxCommit] PASSED test_consistant_parts_after_move_partition/test.py::test_consistent_part_after_move_partition PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxNotFinished] PASSED test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxRollback] PASSED test_failed_async_inserts/test.py::test_failed_async_inserts PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-NoTx] PASSED test_dictionaries_config_reload/test.py::test PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxCommit] PASSED test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxNotFinished] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxRollback] PASSED test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability PASSED test_extreme_deduplication/test.py::test_deduplication_window_in_seconds PASSED test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic PASSED test_compression_nested_columns/test.py::test_nested_compression_codec ================== 72 passed, 28 errors in 528.00s (0:08:47) =================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_a5g77r --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_accept_invalid_certificate/test.py::test_accept test_accept_invalid_certificate/test.py::test_connection_accept test_accept_invalid_certificate/test.py::test_default test_accept_invalid_certificate/test.py::test_strict_connection_reject test_accept_invalid_certificate/test.py::test_strict_reject test_accept_invalid_certificate/test.py::test_strict_reject_with_config test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_backup_log/test.py::test_backup_log 'test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3]' 'test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain]' test_backup_restore_s3/test.py::test_backup_to_s3 test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials test_backup_restore_s3/test.py::test_backup_to_s3_multipart test_backup_restore_s3/test.py::test_backup_to_s3_named_collection 'test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3]' 'test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_other_bucket]' 'test_backup_restore_s3/test.py::test_backup_to_s3_native_copy[policy_s3_plain_rewritable]' test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart test_backup_restore_s3/test.py::test_backup_to_tar test_backup_restore_s3/test.py::test_backup_to_tar_bz2 test_backup_restore_s3/test.py::test_backup_to_tar_gz test_backup_restore_s3/test.py::test_backup_to_tar_lzma test_backup_restore_s3/test.py::test_backup_to_tar_xz test_backup_restore_s3/test.py::test_backup_to_tar_zst test_backup_restore_s3/test.py::test_backup_to_zip 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True]' test_backup_restore_s3/test.py::test_incremental_backup_append_table_def test_backup_restore_s3/test.py::test_user_specific_auth test_backward_compatibility/test_convert_ordinary.py::test_convert_ordinary_to_atomic test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability test_compression_nested_columns/test.py::test_nested_compression_codec test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool test_config_reloader_interval/test.py::test_reload_config test_consistant_parts_after_move_partition/test.py::test_consistent_part_after_move_partition test_dictionaries_access/test.py::test_create test_dictionaries_access/test.py::test_dictget test_dictionaries_access/test.py::test_drop 'test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_executable_cache.py::test_simple[cache]' test_dictionaries_config_reload/test.py::test 'test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0]' 'test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1]' 'test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2]' 'test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3]' test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-partition-all-TxRollback]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[drop-part-TxRollback]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[truncate-TxRollback]' test_executable_user_defined_function/test.py::test_executable_function_always_error_python test_executable_user_defined_function/test.py::test_executable_function_argument_python test_executable_user_defined_function/test.py::test_executable_function_bash test_executable_user_defined_function/test.py::test_executable_function_input_nullable_python test_executable_user_defined_function/test.py::test_executable_function_non_direct_bash test_executable_user_defined_function/test.py::test_executable_function_parameter_python test_executable_user_defined_function/test.py::test_executable_function_python test_executable_user_defined_function/test.py::test_executable_function_send_chunk_header_python test_executable_user_defined_function/test.py::test_executable_function_signalled_python test_executable_user_defined_function/test.py::test_executable_function_slow_python test_executable_user_defined_function/test.py::test_executable_function_sum_json_python test_executable_user_defined_function/test.py::test_executable_function_sum_python test_extreme_deduplication/test.py::test_deduplication_window_in_seconds test_failed_async_inserts/test.py::test_failed_async_inserts 'test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PART-2020-08-28-20200828_0_0_0]' 'test_fetch_partition_from_auxiliary_zookeeper/test.py::test_fetch_part_from_allowed_zookeeper[PARTITION-2020-08-27-2020-08-27]' test_groupBitmapAnd_on_distributed/test.py::test_groupBitmapAnd_on_distributed_table -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.